a-Stratified CAT design with content blocking.
نویسندگان
چکیده
Content balancing is often required in the development and implementation of computerized adaptive tests (CATs). In the current study, we propose a modified a-stratified method, the a-stratified method with content blocking. As a further refinement of a-stratified CAT designs, the new method incorporates content specifications into item pool stratification. Simulation studies were conducted to compare the new method with three previous item selection methods: the a-stratified method; the a-stratified with b-blocking method; and the maximum Fisher information method with Sympson-Hetter exposure control. The results indicated that the refined a-stratified design performed well in reducing item overexposure rates, balancing item usage within the pool, and maintaining measurement precision, in a situation where all four procedures were forced to balance content.
منابع مشابه
Content Balancing in Stratified Computerized Adaptive Testing Designs
For computerized adaptive testing (CAT) programs that adopt three-parameter logistic model, high discriminative items generally provide more information for trait estimation. The information based item selection methods in administering computerized adaptive tests (CATs) tend to choose the item that provides maximum information at an examinee’s estimated trait level. As a result, these methods ...
متن کاملAn Examination of Item Selection Rules by Stratified CAT Designs Integrated with Content Balancing Methods
The multistage a-stratified computerized adaptive testing design advocates a new philosophy on pool management and item selection of using low discriminating items first. It has been demonstrated through simulation studies to be effective both in reducing item overlap rate and enhancing pool utilization with certain pool types. Based on this design, two extended stratification methods have been...
متن کاملImplementing the a-Stratified Method with b Blocking in Computerized Adaptive Testing with the Generalized Partial Credit Model
The purpose of the current study was to generalize the use of the a-stratified method with b blocking (Chang, Qian, & Ying, 2001; denoted STR_B) to computerized adaptive testing (CAT) with the generalized partial credit model (Muraki, 1992). Chang et al. (2001) showed that STR_B performs well in reducing highly discriminating items' exposure rates and increasing lower a items' usage while maint...
متن کاملSeverity of Organized Item Theft in Computerized Adaptive Testing: A Simulation Study
Criteria had been proposed for assessing the severity of possible test security violations for computerized tests with high-stakes outcomes. However, these criteria resulted from theoretical derivations that assumed uniformly randomized item selection. This study investigated potential damage caused by organized item theft in computerized adaptive testing (CAT) for two realistic item selection ...
متن کاملIncorporating the Sympson-Hetter Exposure Control Method into the a-Stratified Method with Content Blocking
Previous research (e.g., Leung, Chang, & Hau, 2001; Yi & Chang, 2001) has shown that the astratified method with content blocking (STR_C) performed well in content balancing constrained computerized adaptive tests (CATs). It effectively reduced the exposure rates of highly discriminating items, produced more balanced item usage within a pool, and maintained measurement precision. This method, h...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- The British journal of mathematical and statistical psychology
دوره 56 Pt 2 شماره
صفحات -
تاریخ انتشار 2003